Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines
نویسندگان
چکیده
In the context of Industry 4.0, companies understand advantages performing Predictive Maintenance (PdM). However, when moving towards PdM, several considerations must be carefully examined. First, they need to have a sufficient number production machines and relative fault data generate maintenance predictions. Second, adopt right approach, which, ideally, should self-adapt machinery, priorities organization, technician skills, but also able deal with uncertainty. Reinforcement learning (RL) is envisioned as key technique in this regard due its inherent ability learn by interacting through trials errors, very few RL-based frameworks been proposed so far literature, or are limited respects. This paper proposes new multi-agent approach that learns policy performed technicians, under uncertainty multiple machine failures. comprises RL agents partially observe state each coordinate decision-making scheduling, resulting dynamic assignment tasks technicians (with different skills) over set machines. Experimental evaluation shows our outperforms traditional policies (incl., corrective preventive ones) terms failure prevention downtime, improving ?75% overall performance.
منابع مشابه
Multi-Agent Deep Reinforcement Learning
This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...
متن کاملLenient Multi-Agent Deep Reinforcement Learning
Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated bec...
متن کاملParallel Fault Tolerant Multi-Agent Reinforcement Learning
Reinforcement learning is a powerful tool for training an agent in a sequential decision based environment and has been successful in many simulated [6] as well as practical [5] domains. In this paper we investigate methods of strengthening the rate of convergence of a single agent RL learner by sharing observations with other independent agents. In contrast to multi-agent reinforcement methods...
متن کاملOperation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملLearning to Communicate with Deep Multi-Agent Reinforcement Learning
We consider the problem of multiple agents sensing and acting in environments with the goal of maximising their shared utility. In these environments, agents must learn communication protocols in order to share information that is needed to solve the tasks. By embracing deep neural networks, we are able to demonstrate endto-end learning of protocols in complex environments inspired by communica...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Robotics and Computer-integrated Manufacturing
سال: 2022
ISSN: ['1879-2537', '0736-5845']
DOI: https://doi.org/10.1016/j.rcim.2022.102406